Deterministic Complexity and Entropy
نویسندگان
چکیده
Lempel and Ziv (1976) proposed a computable string production-complexity. In this paper, our emphasis is on providing the rigorous development, where possible, for the theoretical aspects of a more recent and contrasting measure of string complexity. We derive expressions for complexity bounds subject to certain constraints. We derive an analytic approximation to the upper bound to linearize the complexity measure. The linearized measure enables us to propose an entropy measure, observed elsewhere to correspond closely with the Kolmogorov-Sinai entropy in simple dynamical systems.
منابع مشابه
Entropy and the Complexity of Graphs Revisited
This paper presents a taxonomy and overview of approaches to the measurement of graph and network complexity. The taxonomy distinguishes between deterministic (e.g., Kolmogorov complexity) and probabilistic approaches with a view to placing entropy-based probabilistic measurement in context. Entropy-based measurement is the main focus of the paper. Relationships between the different entropy fu...
متن کاملTopological Entropy of Formal Languages
In this thesis we will introduce topological automata and the topological entropy of a topological automaton, which is the topological entropy of the dynamical system contained in the automaton. We will use these notions to define a measure of complexity for formal languages. We assign to every language the topological entropy of the unique minimal topological automaton accepting it. We contrib...
متن کاملOn Nonlinear Complexity and Shannon's Entropy of Finite Length Random Sequences
Pseudorandom binary sequences have important uses in many fields, such as spread spectrum communications, statistical sampling and cryptography. There are two kinds of method in evaluating the properties of sequences, one is based on the probability measure, and the other is based on the deterministic complexity measures. However, the relationship between these two methods still remains an inte...
متن کاملEvolution of Information and Complexity in an Ever-Expanding Universe
Using the usual definitions of information and entropy in quantum gravity and statistical mechanics and the existing views about the relation between information and complexity, we examine the evolution of complexity in an ever expanding universe.
متن کاملA New Approach to Detect Congestive Heart Failure Using Symbolic Dynamics Analysis of Electrocardiogram Signal
The aim of this study is to show that the measures derived from Electrocardiogram (ECG) signals many a time perform better than the same measures obtained from heart rate (HR) signals. A comparison was made to investigate how far the nonlinear symbolic dynamics approach helps to characterize the nonlinear properties of ECG signals and HR signals, and thereby discriminate between normal and cong...
متن کاملMeasuring communication complexity using instance complexity with oracles
We establish a connection between non-deterministic communication complexity and instance complexity, a measure of information based on algorithmic entropy. Let x, y and Y1(x) be respectively the input known by Alice, the input known by Bob, and the set of all values of y such that f(x, y) = 1; a string is a witness of the non-deterministic communication protocol iff it is a program p that “cor...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
- Fundam. Inform.
دوره 64 شماره
صفحات -
تاریخ انتشار 2005